Gaussian codes and Shannon bounds for multiple descriptions
نویسنده
چکیده
A well known inequality due to Shannon, upper / lower bounds the rate distortion function of a real source by the rate distortion function of the Gaussian source with the same variance / entropy. We extend these bounds to multiple descriptions, a problem for which a general \single letter" solution is not known. We show that the set D X (R 1 ; R 2) of achievable marginal (d 1 ; d 2) and central (d 0) mean squared errors in decoding X from two descriptions at rates R 1 and R 2 satisses where 2 x and P x are the variance and the entropy-power of X, respectively, and D (2 ; R 1 ; R 2) is the distortion region for a Gaussian source with variance 2 found by Ozarow. We further show that like in the single description case, a Gaussian random code achieves the outer bound in the limit as d 1 ; d 2 ! 0, thus the outer bound is asymptotically tight at high resolution conditions.
منابع مشابه
Bounds for Multiple-Access Relay Channels with Feedback via Two-way Relay Channel
In this study, we introduce a new two-way relay channel and obtain an inner bound and an outer bound for the discrete and memoryless multiple access relay channels with receiver-source feedback via two-way relay channel in which end nodes exchange signals by a relay node. And we extend these results to the Gaussian case. By numerical computing, we show that our inner bound is the same with o...
متن کاملShannon-Type Bounds for Multiple Descriptions of a Stationary Source
Multiple description source coding is aimed at achieving graceful degradation in reconstruction quality if portions of the code do not arrive at the decoder. Unfortunately , even the simplest model of two descriptions (and three \receivers") does not have a complete information theoretic solution, with the exception of the quadratic-Gaussian case. We show that the set of achievable marginal (d ...
متن کاملAn Improved Sphere-Packing Bound for Finite-Length Codes on Symmetric Memoryless Channels
This paper derives an improved sphere-packing (ISP) bound for finite-length codes whose transmission takes place over symmetric memoryless channels. We first review classical results, i.e., the 1959 sphere-packing (SP59) bound of Shannon for the Gaussian channel, and the 1967 sphere-packing (SP67) bound of Shannon et al. for discrete memoryless channels. A recent improvement on the SP67 bound, ...
متن کاملPolynomial method in coding and information theory
Polynomial, or Delsarte's, method in coding theory accounts for a variety of structural results on, and bounds on the size of, extremal configurations (codes and designs) in various metric spaces. In recent works of the authors the applicability of the method was extended to cover a wider range of problems in coding and information theory. In this paper we present a general framework for the me...
متن کاملThe Rate of Entropy for Gaussian Processes
In this paper, we show that in order to obtain the Tsallis entropy rate for stochastic processes, we can use the limit of conditional entropy, as it was done for the case of Shannon and Renyi entropy rates. Using that we can obtain Tsallis entropy rate for stationary Gaussian processes. Finally, we derive the relation between Renyi, Shannon and Tsallis entropy rates for stationary Gaussian proc...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- IEEE Trans. Information Theory
دوره 45 شماره
صفحات -
تاریخ انتشار 1999